DICE e - Science Paper 1 Production Storage Resource Broker Data Grids
نویسندگان
چکیده
International data grids are now being built that support joint management of shared collections. An emerging strategy is to build multiple independent data grids, each managed by the local institution. The data grids are then federated to enable controlled sharing of files. We examine the management issues associated with maintaining federations of production data grids, including management of access controls, coordinated sharing of name spaces, replication of data between data grids, and expansion of the data grid federation.
منابع مشابه
DICE iRODS 1 From SRB to iRODS : Policy Virtualization using Rule - based Data Grids
The integrated Rule-Oriented Data System (iRODS) is a rule-based data management system that explicitly characterizes policies as rules controlling server-side workflows. By automating the execution of data management processes, petabyte-sized collections can be assembled and managed, with minimal administrative labor support. By defining rules that evaluate assessment criteria, the trustworthi...
متن کاملPolicy-based Distributed Data Management Systems
The integrated Rule-Oriented Data System (iRODS) is a data grid that manages distributed data. The iRODS system is used to support data sharing, data publication, data preservation, and data analysis. These data management applications depend upon very similar data manipulation capabilities, but differ in terms of their management policies. The iRODS data grid organizes distributed data into a ...
متن کاملUser requirements from the academic science community drove the implementation of data management technology, and the evolution of data grid capabilities from simple data management to information and knowledge management. The SRB and iRODS systems
The Data Intensive Computing Environments group has been developing data grid technology for twenty years. Two generations of technology were created, the Storage Resource Broker SRB (1994-2006) and the integrated Rule Oriented Data System iRODS (2004-2016). Both products represented pioneering technology in distributed data management and were widely applied by communities interested in not on...
متن کاملImplementing Preservation Services over the Storage Resource Broker
Many international institutions and organizations responsible for managing large distributed collections of scientific, cultural and educational resources are establishing data grids that employ the San Diego Supercomputer Centre’s Storage Resource Broker (SRB) for managing their collections. Over time, maintaining access to the resources stored within SRB data grids will become increasingly di...
متن کاملBaBar Experiment Data Distribution using the Storage Resource Broker
This paper describes the layout and experience in distributing large volumes of data from SLAC to CC-in2p3 and RAL. We describe the experience using the Storage Resource Broker to distribute more than 120TB of data from SLAC to CC-in2p3 and the experience in using a Grid tool in a production environment. We also describe the plans for extending the system to distribute BaBar data to RAL using t...
متن کامل